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INTRODUCTION 

The standard methodologies for the design 
and conduction of randomized controlled 
trials (RCTs) are often difficult to be 
directly applied when older persons com- 
pose the target population (Pahor and 
Cesari, 2012). In fact, specific methodolog- 
ical adaptations are often required to guar- 
antee the feasibility of the trial, ensure the 
participants' adherence/compliance to the 
protocol, and allow the unbiased/proper 
interpretation of the findings. In this paper, 
we present the case of a frequently ignored 
issue potentially affecting the interpreta- 
tion of results generated by RCTs. In par- 
ticular, we describe how the health sta- 
tus fluctuations of older persons (espe- 
cially in the presence of frailty) may bias 
the randomization procedures. Possible 
solutions to such phenomenon are also 
offered. 

CLINICAL TRIALS IN OLDER PERSONS 

Randomized controlled trials represent the 
gold standard for the assessment of efficacy 
and effectiveness of interventions. Given 
the socio-demographic trends of our soci- 
eties, the conduction of trials in older per- 
sons is growingly becoming pivotal. How- 
ever, old age often implies special chal- 
lenges in the design of intervention studies 
from methodological, clinical, and social 
viewpoints (Pahor and Cesari, 2012). In 
particular, the representativeness of the 
study sample (and, consequently, the possi- 
ble future generalization of the study find- 
ings) is often affected by the complexity of 
this population. 

The definition of eligibility criteria in 
the design of RCTs always represents a cru- 
cial and delicate step. The choices done at 
this time can drastically change the results 
of the study and concur at determining the 



success of the project. Such step becomes 
even more difficult when the trial is aimed 
at exploring age-related conditions. In fact, 
the (sub)clinical accumulation of deficits 
occurring with aging leads to pathophys- 
iological modifications potentially mining 
the "purity" of diseases (Cesari et al., 2013). 
The age-related reduction of homeosta- 
tic mechanisms against entropic forces (or 
frailty) (Morley et al, 2013) exposes the 
older organism at multiple and interacting 
conditions whose clinical manifestations 
might often be masked or altered (Stu- 
denski, 2009). This issue is at the basis of 
the well-known "evidence based medicine" 
problem severely affecting the applicability 
of clinical recommendations and guide- 
lines to elders (Scott and Guyatt, 2010). 
On one side, we cannot ignore the need 
of extending as much as possible the study 
of interventions to the most fastly grow- 
ing subgroup of our societies (both in 
absolute as well as relative terms). On the 
other hand, we also need to acknowledge 
a certain inadequacy of traditional stan- 
dards adopted in clinical trials for judg- 
ing the efficacy of interventions in the 
most advanced phases of the aging process 
(Pahor and Cesari, 2012). 

EVOLUTION OF AGE-RELATED 
CONDITIONS 

If time plays a major and evident role in 
the determination of clinical phenotypes, 
ignoring its importance in the design of 
the study and the definition of eligibil- 
ity criteria may severely affect the con- 
duction of the trial and potentially bias 
its conclusions. This is particularly true 
for evolving clinical processes character- 
ized by non-linear trajectories, such as the 
age-related disabling cascade commonly 



depicted as a sigmoidal decline of physi- 
cal function or a self-feeding and acceler- 
ating vicious cycle (Ferrucci et al., 2002). 
If the development of a clinical condition 
does not follow a linear pattern (as fre- 
quently happening among older persons) 
a single-point or mono-dimensional eval- 
uation may not be sufficient to adequately 
appreciate the health status of the indi- 
vidual. In other words, the history of the 
condition of interest imposes to take into 
account the often ignored "horse-racing 
effect" when designing an ad hoc RCT. 

THE HORSE-RACING EFFECT 

The horse-racing effect has been origi- 
nally advocated to explain observational 
studies exploring the increase of clini- 
cal parameters (e.g., blood-pressure) with 
aging (Anonymous, 1981). It postulates 
the existence of a close correlation between 
the aging process and the health status 
as the speed of the horse is related to its 
position in the race. Nevertheless, a super- 
ficial observation of results may lead to 
arguable conclusions. Thus, for example, 
the interpretation of results showing that 
blood-pressure increases with advancing 
age might meaningfully shift from "the 
higher they start, the faster they rise" to 
"the faster they rise, the higher they are" 
(Peto, 1981). Such contradicting interpre- 
tation does not only affect the analysis of 
results coming from observational stud- 
ies. The same risk can easily endanger the 
correct decoding of findings from RCTs. 

In Figure 1, a graphical description of 
the relevance of the horse-racing effect in 
RCTs is provided. Figure lA depicts the 
characteristic and schematic overview of 
results from a RCT. At the time 0 visit ( V o ) > 
participants are randomized according to 
a major clinical characteristic rendering 
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FIGURE 1 1 Graphical description of the "horse-racing effect" in randomized clinical trials, l/g and 

V, indicate tine assessments conducted at tlie baseline and follow-up visits of the trial, respectively. \/_„ 
represents a hypothetical assessment conducted some time before Vo - x, y, and z describe the 
trajectories of the variable of interest for the three randomization groups of the trial. Although the three 
groups (x, y, and z) seem to be correctly randomized and starting at a similar level at the baseline visit 
(A), they are indeed characterized by pre-existing differences in their trajectories (B). Such differences 
significantly affect the interpretation of trial results. 



the intervention groups as much homoge- 
neous as possible in relationship with the 
study outcome. Let's say, for example, a 
Mini Mental State Examination (MMSE) 
score >24 to explore the risk of incident 
dementia. After two or more interventions 
are conducted for a certain period of time, 
we can judge the effects of the different trial 
arms by comparing the difference of the 
key variable of interest between Vy (end 
of the trial visit) and Vq (baseline visit). 
Such approach is legitimate and frequently 
adopted, but presents a high risk of biased 
results due to: (1) the limited observation 



of the phenomenon of interest, and (2) the 
fluctuating value of the variable of inter- 
est. In fact, the randomization procedure 
according to a specific and single criterion 
may not adequately take into account what 
happened before the observation began in 
the three groups. It is like looking at a pic- 
ture shot at the photo-finish during a horse 
race: we get the idea about the winner, but 
our conclusion is justified only because we 
are sure that horses indeed began running 
together and from the same stating-point at 
the gunshot. Translating such concept into 
the reality of RCTs, it becomes evident that 



the observation period (i.e., trial follow- 
up) is infinitesimally shorter compared to 
the race already covered before the baseline 
visit (i.e., participant's life-course), espe- 
cially if the subject is an older person. In 
other words. Figure lA becomes arguable 
and misleading if what happened before 
the baseline visit is not adequately consid- 
ered. In fact, the positive effect of an inter- 
vention (x) compared to the others (y and 
z) might be simply be explained by the less 
steep decline that participants in that group 
were already experiencing before the ran- 
domization phase. If the observation could 
be left-extended to any previous time-point 
V_„ (Figure IB), the interpretation of the 
X, y, and z trajectories will lead to com- 
pletely different conclusions (i.e., lack of 
relevant effects). After all, since between 
two points only one line can be drawn, the 
identification of a third point (e.g., V-„) 
in the appreciation of results will allow 
to determine possible knots of flection 
and provide a more accurate evaluation of 
results. 

Just to give an example, a cluster- 
randomized trial was conducted to explore 
the effectiveness of a specific care 
plan in patients with mild-to-moderate 
Alzheimer's disease (Nourhashemi et al., 
2010). The main eligibility criteria of the 
trial were the possible or probable diagno- 
sis of Alzheimer's disease, and MMSE score 
between 12 and 26. As also mentioned by 
the Authors among the study limitations, 
the selection of participants (largely rely- 
ing on the MMSE results for judging the 
cognitive status) might have been biased 
the entry criteria, and potentially affected 
the homogeneity of the sample. 

HOW TO TAKE INTO ACCOUNT THE 
HORSE-RACING EFFECT IN CLINICAL 
TRIALS 

In order to allow the correct interpretation 
of RCTs (especially for age-related con- 
ditions), the clinical, behavioral, biologi- 
cal, and social experiences occurred before 
the study start cannot be overlooked. The 
definition of the entry criteria based on 
a multiple-point observation (for exam- 
ple, a test administered twice at the dis- 
tance of some time to guarantee the sta- 
bility of the condition) might represent 
a solid method for limiting the "horse- 
racing effect." As an alternative, it might 
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be chosen to combine a double evalua- 
tion of potential participants using the 
variable of interest (e.g., MMSE score) in 
conjunction with a more global measure 
of disease severity (e.g., Clinical Dementia 
Rating), with this latter somehow serving 
as surrogate of exposure time to the risk 
condition. It should not even be under- 
estimated the role that specific measures 
estimating the aging status of the individ- 
ual may play in this context. For exam- 
ple, the Frailty Index proposed by Rock- 
wood and colleagues (measuring the age- 
related deficit accumulation of the indi- 
vidual) (Rockwood et al., 2005) or the 
usual gait speed (intended as an addi- 
tional vital sign) (Cesari, 2011) may sup- 
port the results of the measured phenom- 
enon by providing additional informa- 
tion about the global health status of the 
participant. 

It might be thought that the random- 
ization of participants in the different 
arms of the clinical trial might be suf- 
ficient to take into account the horse- 
racing effect. In fact, it is likely that the 
random allocation of participants to the 
study interventions might also equally dis- 
tribute their characteristics and under- 
lying conditions, and consequently the 
"abnormal" trajectories. This is not com- 
pletely true. The randomization proce- 
dures may reduce the risk of an unequal 
distribution of participants' characteris- 
tics, but cannot be considered foolproof, 
especially for those variables that are not 
object of specific stratification. Moreover, 
the randomization does not act on the 
clear and optimal definition of the sam- 
ple population, but is simply aimed at 
guaranteeing the fair comparison across 
groups. Thus, if the horse-racing effect is 
not adequately addressed in the ehgibil- 
ity criteria of the trial participants, the 



resulting groups might be similar (thanks 
to the randomization), but still poten- 
tially include completely different condi- 
tions (e.g., MMSE = 25 may indicate a per- 
sons with early signs of neurodegenerative 
disorder as well as a person with poor 
education). 

Last but not least, it is important to 
raise awareness about the inadequacy of 
the standard methodology adopted in tra- 
ditional RCTs (targeting adults) when this 
is applied to studies recruiting older partic- 
ipants (Pahor and Cesari, 2012). The com- 
plexity of the older person (especially in 
the presence of geriatric conditions) indeed 
requires special adaptations capable to tak- 
ing into account his/her extreme vulnera- 
bility to stressors. In particular, researchers 
should understand the necessity of shift- 
ing from a disease-oriented approach (typ- 
ical of RCTs in adults) to a holistic and 
function-oriented one in order to design 
informative and robust RCTs in older per- 
sons (Studenski, 2009). 

CONCLUSION 

The "horse-racing effect" described in the 
context of observational studies of aging 
represents a major source of confounding 
in RCTs, too. Researchers should become 
more aware about the risks of conducting 
one-point and mono-dimensional assess- 
ments at the recruitment phase of inter- 
vention studies targeting age-related con- 
ditions. 

REFERENCES 

Anonymous. (1981). Why does blood-pressure rise 

with age? Lancet 318, 289-290. doi:10.1016/S0140- 

6736(81)90532-8 
Cesari, M. (2011). Role of gait speed in the assessment 

of older patients. JAMA 305, 93-94. doi:10.1001/ 

jama.2010.1970 
Cesari, M., Vellas, B., and Gambassi, G. (2013). The 

stress of aging. Exp. Gerontol. 48, 451-456. doi:10. 

1016/j.exger.2012. 10.004 



Ferrucci, L., Cavazzini, C, Corsi, A., Bartali, B., Russo, 
C. R., Lauretani, R, etal. (2002). Biomarkers of 
frailty in older persons. /. Endocrinol Invest. 25, 
10-15. 

Morley, J. E., Vellas, B., van Kan, G. A., Anker, S. D., 
Bauer, J. M.,Bernabei, R.,et al. (2013). Frailty con- 
sensus: a call to action. /. Am. Med. Dir. Assoc. 14, 
392-397. doi:10.1016/j.jamda.2013.02.020 

Nourhashemi, F., Andrieu, S., Gillette- Guyonnet, S., 
Giraudeau, B., Cantet, C, Coley, N., et al. (2010). 
Effectiveness of a specific care plan in patients 
with Alzheimer's disease: cluster randomised trial 
(PLASA study). BM} 340, c2466. doi:10.1136/bmj. 
c2466 

Pahor, M., and Cesari, M. (2012). "Study design: ran- 
domized controlled trials," in The Epidemiology of 
Aging, eds A. B. Newman and J. A. Cauley (New 
York, NY: Springer), 27-47. 

Peto, R. (1981). The horse-racing effect. Lancet 2, 
467-468. doi:10.1016/S0140-6736(81)90791-l 

Rockwood, K., Song, X., MacKnight, C, Bergman, H., 
Hogan, D. B., McDowell, I., et al. (2005). A global 
clinical measure of fitness and frailty in elderly peo- 
ple. CMA} 173, 489-495. doi:10.1503/cmaj.050051 

Scott, I. A., and Guyatt, G. H. (2010). Cautionary tales 
in the interpretation of cHnical studies involving 
older persons. Arch. Intern. Med. 170, 587-595. 
doi: 10.100 1 /archinternmed.20 10.18 

Studenski, S. (2009). Target population for clinical tri- 
als. /. Nutr. Health Aging 13, 729-732. doi:10.1007/ 
S12603-009-0205-8 

Conflict of Interest Statement: The authors declare 
that the research was conducted in the absence of any 
commercial or financial relationships that could be 
construed as a potential conflict of interest. 

Received: 08 February 2014; accepted: 01 July 2014; 
published online: 16 July 2014. 

Citation: Cesari M and Canevelli M (2014) Horse- 
racing effect and clinical trials in older persons. Front. 
Aging Neurosci. 6:175. doi: 10.3389/fnagi.20 14.00 175 
This article was submitted to the journal Frontiers in 
Aging Neuroscience. 

Copyright © 2014 Cesari and Canevelli. This is an open- 
access article distributed under the terms of the Creative 
Commons Attribution License (CC BY). The use, dis- 
tribution or reproduction in other forums is permitted, 
provided the original author(s) or licensor are credited 
and that the original publication in this journal is cited, 
in accordance with accepted academic practice. No use, 
distribution or reproduction is permitted which does not 
comply with these terms. 



Frontiers in Aging Neuroscience 



www.frontiersin.org 



July 2014 I Volume 6 | Article 175 | 3 



